Visual Sign Language Recognition Based on HMMs and Auto-regressive HMMs
نویسندگان
چکیده
A sign language recognition system based on Hidden Markov Models(HMMs) and Auto-regressive Hidden Markov Models(ARHMMs) has been proposed in this paper. ARHMMs fully consider the observation relationship and are helpful to discriminate signs which don’t have obvious state transitions while similar in motion trajectory. ARHMM which models the observation by mixture conditional linear Gaussian is proposed for sign language recognition. The corresponding training and recognition algorithms for ARHMM are also developed. A hybrid structure to combine ARHMMs with HMMs based on the trick of using an ambiguous word set is presented and the advantages of both models are revealed in such a frame work.
منابع مشابه
MAN-MACHINE INTERACTION SYSTEM FOR SUBJECT INDEPENDENT SIGN LANGUAGE RECOGNITION USING FUZZY HIDDEN MARKOV MODEL
Sign language recognition has spawned more and more interest in human–computer interaction society. The major challenge that SLR recognition faces now is developing methods that will scale well with increasing vocabulary size with a limited set of training data for the signer independent application. The automatic SLR based on hidden Markov models (HMMs) is very sensitive to gesture's shape inf...
متن کاملPerception and Synthesis of Biologically Plausible Motion: From Human Physiology to Virtual Reality
Temporal measures of hand and speech coordination during French cued speech production p. 13 Using signing space as a representation for sign language processing p. 25 Spatialised semantic relations in French sign language : toward a computational modelling p. 37 Automatic generation of German sign language glosses from German words p. 49 French sign language processing : verb agreement p. 53 R...
متن کاملASL Recognition Based on a Coupling Between HMMs and 3D Motion Analysis
We present a framework for recognizing isolated and continuous American Sign Language (ASL) sentences from three-dimensional data. The data are obtained by using physics-based three-dimensional tracking methods and then presented as input to Hidden Markov Models (HMMs) for recognition. To improve recognition performance, we model context-dependent HMMs and present a novel method of coupling thr...
متن کاملParallel Hidden Markov Models for American Sign Language Recognition
The major challenge that faces American Sign Language (ASL) recognition now is to develop methods that will scale well with increasing vocabulary size. Unlike in spoken languages, phonemes can occur simultaneously in ASL. The number of possible combinations of phonemes after enforcing linguistic constraints is approximately 5:5 108: Gesture recognition, which is less constrained than ASL recogn...
متن کاملSign Language Recognition
Our goal here is to recognize a sign language measured from wearable sensor gloves. A sign language is expressed as a sequence of gestural patterns to convey a meaning. Hidden Markov models (HMMs) have been shown to be successful in temporal pattern recognition, such as speech, handwriting, and gesture recognition [4]. In this project, we investigate how well HMMs can perform when applied to si...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2005